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(54) Method an apparatus for image interpolation 

(57) In an image processing method, an image is 
read by an image processing apparatus such as a dig- 
ital copying machine and the read image is divided into 
blocks composed of a plurality of picture elements. 
Thereafter, interpolation is performed on a target picture 
element so that the image is scaled. Then, in the above 
image processing method, region segmentation data, 
which represent possibilities of characters, photographs 
and mesh dots of the target picture element of the 
image, are detected in a region segmentation section of 
the image processing apparatus, and the interpolated 
picture element data of the target picture element are 
computed by a variable scaling section according to an 
equation in which density of a plurality of adjacent pic- 
ture elements in the vicinity of the target picture element 
are inputted. At this time, a weights of the density of 
each adjacent picture element in the equation is 
adjusted based upon the result detected by the region 
segmentation means. As a result, even if characters, 
photographs and mesh dots coexist in an image read by 
a scanner, the image is scaled according to the charac- 
ters, photographs and mesh dots, thereby preventing 
deterioration in image quality. 
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[0135] Note a dot surrounded by two-dot chain line. This dot is not considered to be particularly necessary. The 

e Tl ShOW ! "" e •" ilh *** ^ * is difHcu,t 10 ^PP 058 the necess rty ™ a projecting dot is 
affixed at the corner. In other words, it is proper to determine that the dot should not be affixed as shown in Rg 298 

™t e ^™2f!L 0n Ca t ? n °V abS0lutely 1)6 made the ^gion becomes smaller. However, when sixteen pixels are 
compared with the pattern data as m the embodiment, such determination can be made. 

10136] On the premise as described above, regarding the pattern data containing the dot as shown In Fig. 29C 
interpolating pixel information is caused to correspond to the image data. When the pixel as noise produced when the 
metacommand pixel is translated and drawn is processed through the pattern matching, the same effect is achieved as 
if the noise pixel is found and deleted in a conversion process and an interpolating pixel is generated so as to corre- 
spond to the original metacommand pixel. 

10137] It is obvious that the above-described dot deleting manner can be applied generally to the metacommand 
Accordingly, when a dot considered to be noise is generated in the square range of sixteen pixels, interpolating pixel 
information in which the dot has been deleted is caused to correspond to the pattern data. However, the character has 
a special charactenstic that a large number of drawing commands are applied to a small region, and accordingly a 
noise dot tends to be easily generated. As a result, the noise can easily be specified. 

[01 38] On the premise that the above-described interpolating process is executable, the image is read out for every 
type and the interpolating process is carried out at step ST406. The image is roughly divided into a non-metacommand 
pixel and a metacommand pixel. The interpolating process by the cubic method or the nearest method is carried out for 
the former as shown in Rg. 30. The interpolating process by the pattern matching is carried out for the latter as shown 
in Fig. 31 . Figs. 32A and 32B show a case where image data is read out by one line for every type of image. The pixels 
are sorted out while it is determined whether each pixel on the color information virtual drawing screen is a non-meta- 
command pixel (N) or a metacommand pixel (C or B) on the basis of attribute information virtual drawing screen. Pixel 
information previously initialized as background pixels is applied when sorted. 

[0139] Only the horizontal arrangement of the pixels is insufficient for execution of the interpolating process and 
information about pixels in the vertical direction is also necessary. Accordingly, four lines of pixels are actually read out 
to be stored on the work area and the interpolating process is then carried out as shown in Figs. 33A and 33B Four 
lines are read out since square sixteen pixels (4x4) are a processing unit in the cubic method or the pattern matching. 
The number of lines may be increased or decreased as occasion demands. 

[0140] In the interpolating process by the above-described pattern matching, a dot affixed as a metacommand pixel 
is sometimes deleted. Since this dot is a noise dot the metacommand pixel recovers its original contour by deletion of 
the dot. However, a process for compensating the dot to be deleted by another pixel. Accordingly, in a case where a dot 
is deleted when different types of pixels are adjacent to each other, a gap may be produced between the pixels. 
[0141] In such a case, a region is previously expanded with respect to the adjacent pixels. Even in a case where a 
background pixel is generated in the margin when the interpolating process is carried out for the other image, the gap 
is prevented from being exposed since a pixel in the adjacent image region is generated in the foundation. Accordingly, 
a margin extending process is carried out for the non-metacommand pixel at step ST502. In the margin extending proc- 
ess, the margin of the pixel is previously extended in the peripheral edge thereof. In Figs. 32A to 32C. when the non- 
metacommand pixel is read out one pixel is copied outside a pixel adjacent to the background pixel, whereby the mar- 
gin extending process is carried out 

[0142] Figs. 34A to 34D show a countermeasure in the interpolating process carried out after the above-described 
margin extension. In Rg. 34A, three (A to C) of nine pixels contain pixel information and the other six pixels are back- 
ground pixels. One pixel adjacent to the margin is copied outside the margin, so that the margin is extended, as shown 
in Fig. 34B. When the margin is not extended, the result of the interpolating process is shown in Fig. 34C. When the 
interpolating process is carried out after the margin extension, the original margin is outwardly spread as shown in Rg. 
34D. Consequently, the foundation is formed for the adjacent pixel. Although the margin is extended outward by one 
pixel in the example, the margin may be extended by the number of pixels according to the number of dots to be deleted 
by the pattern matching with respect to the adjacent metacommand pixels. 

[0143] At step STS02, the margin extending process is carried out in the above-described sense. The interpolating 
process by the cubic method is carried out at step ST504, that is, metacommand pixels are read out and the interpolat- 
ing process most suitable for the natural image is carried out 

[0144] in Fig. 30, chain line denotes a determining process as to whether the image is a natural image and the 
interpolating process by the nearest method. As described above, the embodiment shows that a bit-map image is deter- 
mined to be a metacommand pixel but the image may further be determined whether it is a natural image. Accordingly 
the image is written on the virtual region so that types of metacommand pixels are recognizable. At step ST508. the 
determination is made as to whether the image is a natural image. When the image is a natural image, the interpolating 
process by the cubic method is carried out at step ST504 as described above. When the image is not a natural image 
the interpolating process by the nearest method is carried out at step ST51 0. 

[0145] Regarding metacommand pixels, the interpolating process by the pattern matching is carried out at step 
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S «SSSd3?- a * ima9e ^ no ""^ dot is ^ a ™* • u «— irter p° ,at - 

[0146] Regarding the metacommand pixels, dots sometimes lack in the interpolating process. As a countermeas- 
Z'rwZr^y ^ te 001 for "* "on-metacomnwSl P ixe! 9 a P nd a^etaconSa^ pTxdfs 

^£^2£f?" "IT " ,ir5!,y ^ St StSP ST506 ^ *• plating process concerning the 
non-metacommand pixel. Regarding the metacommand pixel, the image is secondly written at step ST608 after the 
•rtemo.at.nfl , process. Steps ST506 and ST608 in Figs. 30 and 31 respectively are shown by chai?line. These^oc 
esses actually correspond to the interpolated pixel superposing process at step ST408 in Fig 27 
10 [0147] Describing significance of the first writing step ST506 and the following writing step ST408. the non-meta- 
command pixel and the metacommand pixel are separated from each other and these pixels are interpolated in sepa- 

I~ e .^ r * "ST * e Pixete are Conibined tne non-metacommand pixel for which the margin 

has been extended is firstly written, and the metacommand pixel for which the interpolating process has been carried 
out in correspondence to the original metacommand pixel is secondly written. In this case, when the firstly written pixel 

15 and the second written pixel are not overlapped, the firstly written pixel is maintained. When the pixels are overlapped 
ttie secondly written pixel is maintained. Accordingly, the foundation is not exposed even when the marginal contour of 
the secondly written pixel is changed at the margin where both pixels are adjacent to each other. Overwriting is unnec- 
essary for background pixels. Pixels to be overwritten are those other than the background pixels 

« ""Sf 81 ™ 8 " ritinfl _ 0,der fe 0ne mode * a Preferential process in the superposing process. A control manner for the 
T £ Preferential process is varied on an actual program. Accordingly, the preferential process can only 

be substantially maintained. The same process may be realized by another technique. 

[0149] When the interpolated pixels are superposed, a color correction is carried out for conversion of color coor- 
dinates from RGB to CMYK at step ST410. A naff tone process is carried out at step ST412 since the color printer 1 7b 
has two gradations. Print data is output to the color printer 1 7b at step ST41 4. - 
25 !J2f°J I 6 fore90ina descri Pti°" relates to the printer driver 12c and can also be applied to the display driver 12b 
[0151] The interpolating process is carried out in consideration of the original metacommand with respect to the 
pixel generated in correspondence to the metacommand, so that the processed image itself can be improved However 
the marginal region does not correspond with the adjacent pixel. In order that this unanturaJness may be solved the 
margin is extended concerning the non-metacommand pixel and the interpolating process is then carried out Further 
the metacommand pixel has preference in the portion where the metacommand and non-metacommand pixels are 
superposed. Almost all the extended margin becomes the foundation of the adjacent region to thereby be concealed 
However, generation of the background pixel can be prevented when the marginal contour is changed. 

INDUSTRIAL APPLICABILITY OF THE INVENTION 

[0152] According to the invention of claim 1 . an interpolating process corresponding to every type of image data is 
earned out Consequently, the image data interpolating apparatus can provide a fine interpolated image even when dif- 
ferent type of image data are co-existent 

[0153] According to the invention of daim 2. writing onto the virtual region can be accomplished easily 
[Ot54] According to the invention of claim 3. adjustment is performed according to the characteristic of the interpo- 
ating process in the superposition since the processing near the margin tends to differ depending upon the interpolat- 
ing process. Consequently, a fine marginal configuration can be obtained. 

[0155] According to the invention of daim 4. the foundation for the marginal portion can be generated since the 
margin is extended. Consequently, influences due to lack of pixels in the adjacent image data can be eliminated. 
[0156] According to the invention of daim 5. when information outside the margin is drawn in, a pixel about which 
information is absent This results in the same influences as those due to lack of pixels. The influences can be pre- 
vented by previous extension. 

[0157] According to the invention of claim 6. no gap is produced near the marginal portion even when such a 
processing as to positively smooth the marginal configuration in the image interpolating process for the metacommand 
Consequently, desired results of interpolation can be achieved. 

[0158] According to the invention of daim 7. a processing for expanding the peripheral region can easily be per- 
tot moo. 

[0159] According to the invention of claim 8. the processing can be simplified since the adjustment is performed bv 
the sequence. J 

[0160] According to the invention of each of claims 9 to 16. the image data interpolating method achieving the same 
effects as described above can be provided. 

[0161] According to the invention of each of claims 17 to 24, the medium on which the image data interpolating pro- 
gram achieving the same effects as those described above is recorded can be provided. 
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an interpolating unit (C13) which distinguishes a plurality of image types of the pixels based on th* a ttr,h.^ 
a synttesizino unit (CI 4) which synthesizes the pixels mtenjolaw by the am intt-poMns presses. 

t^es^ofd^K^^^ 8 aCCOrdin9 to any ° ne * claims 1 to 5. characterized in that said plurality of 
anonnrietacomrnand pixel interpolating unit (C23) which enlarges a marginal region when the pixel corre- 

rnand and performing an .nterpolating process so that the interpolating scale factor is otSained 

??" ^ unit (C25) synthesized resuK of imeSoX ^non-metacom- 

mand p,xel M-Pouno unit and a result of interpolation by the metacommand pixel I^SS^mT^SZ. 

^Z^l^Z^T - in,erP0,afi ° n * ^ m6te ™ - unJS 
WemS^lV^S 0131 *" 9 T mM "' aCCOrdin9 10 C ' aim 6 ' char ***«d h that the non-metacommand pixel 

SlSIu^SS T ratUS aCC0,din9 10 ^ ° ne * daimS 1 to 7 " i" *atthe synthesizing 

S«ri ^ 8 rr i T 8te thS TeSU « " by the metac^rr^xe. inter? 

IS SSS ba< *9 r °»"d P«e<s on the result of interpo.at.on by the non-metacommand pixel inter- 

for every one of the .mage types to each one of the pixels, and synthesizing the pixels Nerpote^b^l SIS 
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1 0. The image data interpolating method according to claim 9. characterized in that the plurality of types of image data 
having different r mage types are input and superposed in a predetermined order in a virtual region with the image 
types bang rendered distinguishable, thereby drawing in a virtual region, and the image data is read out from the 
virtual region. 

11. ^e image data interpolating method according to claim 9 or 10. characterized in that superposition of margins of 
the image data after interpolation of the pixels is adjusted. 

1 2. The image data interpolating method according to claim 1 1 , characterized in that when the image data is read out 
the image data with a margin enlarged is read out and the image data is superposed on the image data interpolated 
by the interpolating means on the basis of the image data with the enlarged margin. 

is 13. The image data interpolating method according to claim 12, characterized in that the margin of the image data is 
enlarged with respect to an interpolating process in which information outside the margin is drawn in. 

14. The image data interpolating method according to any one of claims 9 to 13, characterized in that: 

said plurality of types of image data having different image types include image data corresponding to a meta- 
command and other image data; 

a marginal region is enlarged when the pixel corresponding to the image data other than the metacommand 
and an interpolating process is performed so that a predetermined interpolation scale factor is obtained 
an interpolated pixel is generated so that the interpolated pixel corresponds to the original metacommand 
when the pixel corresponding to the metacommand is read out and an interpolating process is performed so 
that the interpolating scale factor is obtained, and 

a result of interpolation by the non-metacommand pixel interpolating means and a result of interpolation by the 
metacommand pixel interpolating means are synthesized, the result of interpolation by the metacommand 
pixel interpolating means being preferred with respect to the superposed portion. 

15. The image data interpolating method according to claim 14, characterized in that information about the pixel in the 
marginal region is used as information about a pixel outside the marginal region. 

16. The image data interpolating method according to any one of claims 9 to 15, characterized in that the pixels are 
synthesized with the result of interpolation by the metacommand pixel interpolating unit (C24) other than back- 
ground being superposed on the pixels in the result of interpolation by the non-metacommand pixel interoolatina 
unit(C23). * 

17. A medium on which an image data interpolating program is recorded, the program accomplishing the function of 
obtaining image data containing attribute information capable of distinguishing a type of image in the unit of pixel 
and enlarging the image data by an interpolating process, the program accomplishing on a computer the steps of: 

reading out image data; and 

distinguishing a plurality of image types of the pixels based on the attribute information, applying one of a plu- 
rality of interpolating processes differing for every one of the image types to each of the pixels, and synthesiz- 
ing the pixels interpolated by the different interpolating processes. 

18. The medium according to claim 1 7, characterized in that the plurality of types of image data having different image 
types are input and superposed in a predetermined order in a virtual region with the image types being rendered 
distinguishable, thereby drawing in a virtual region, and the image data is read out from the virtual region. 

19. The medium according to claim 17 or 18, characterized in that superposition of margins of the image data after 
interpolation of the pixels is adjusted. 

20. The medium according to claim 19. characterized in that when the image data is read out. the image data with a 
margin enlarged is read out and the image data is superposed on the image data interpolated by the interpolating 
unit (C13) on the basis of the image data with the enlarged margin. 
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21 " I!l iS claim 20^haracteri 2 ed in that the margin of the image data is enlarged with respect to 

an interpolating process in which information outside the margin is drawn in. 

22. The medium according to any one of claims 1 7 to 21 , characterized in that: 

said plurality of types of image data having different image types include image data corresponding to a meta- 
command and other image data, * 
a marginal region is enlarged when the pixel corresponding to the image data other than the metacommand 
and an interpolating process is performed so that a predetermined interpolation scale factor is obtained 
an interpolated pixel is generated so that the interpolated pixel corresponds to the original metacommand 
when the pixel corresponding to the metacommand is read out and an interpolating process is performed so 
that the interpolating scale factor is obtained, and 

a result of interpolation by the non-metacommand pixel interpolating unit and a result of interpolation by the 
metacommand picture element interpolating unit are synthesized, the result of interpolation by the metacom- 
mand pixel interpolating unit being preferred with respect to the superposed portion. 

23. The medium according to claim 22. characterized in that information about the pixel in the marginal region is used 
as information about a pixel outside the marginal region. 

24. ^e medium according to any one of claims 17to23. characterized in that the pixels are synthesized with the result 
of interpolation by the metacommand pixel interpolating unit (C24) other than background being superposed on the 
pixels in the result of interpolation by the non-metacommand pixel interpolating unit (C23). 
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